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ORNSTE IN-UHLENBECK  PROCESSES 


by 

Ian  N.  McKeague 

ABSTRACT 

The  maximum  likelihood  estimator  for  parameters  in  the  gen¬ 
erating  operator  of  an  infinite  dimensional  Omstein-Uhleabeck 
process  is  shown  to  be  consistent  and  asymptotically  normal.  The 
generating  operator  of  the  process  is  assumed  to  be  in  the  form  of  a 
finite  linear  combination  of  fixed  commuting  dissipating  operators 
and  the  coefficients  in  the  linear  combination  represent*  the  un¬ 
known  parameters. 
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1.  Introduction 


Infinite  dimensional  Ornstein-Uhlenbeck  processes  have  re¬ 
cently  been  of  interest  as  node Is  arising  in  a  wide  variety  of 
physical  phenomena:  quantum  mechanics  [3],  scattering  theory 
[103,  neural  response  [113,  stochastic  control  [53,  chemical  re¬ 
action  problems  CS,  123  and  as  limiting  cases  in  infinite  particle 
systems  C63.  From  the  point  of  view  of  applications  it  is  important 
to  have  a  statistical  theory  for  the  estimation  of  unknown  para¬ 
meters  in  such  models.  Despite  the  presence  of  a  considerable 
literature  (see  the  survey  in  [2,  Ch.  93)  on  estimation  for  finite 
dimensional  diffusion  processes,  estimation  for  infinite  dimensional 
diffusion  processes  has  received  little  attention.  The  recent  paper 
of  Bagchi  and  Borkar  [13  appears  to  be  the  first  to  address  such 
problems. 

In  the  present  paper  we  .study  the  asymptotic  behavior  of  the  maximum 
likelihood  estimator  for  parameters  in  the  generating  operator  of  an 
infinite  dimensional  Omstein-Uhlenbeck  process.  The  parameters  are 
coefficients  in  a  finite  linear  combination  of  known  operators  which 
are  assumed  to  commute.  The  estimator  is  shown  to  be  consistent  and 
asymptotically  normal.  Our  approach  is  quite  different  from  [13. 

2.  Preliminaries. 

The  basic  theory  to  be  used  in  this  work  is  the  generalization 
of  Ite's  stochastic  calculus  to  abstract  Wiener  spaces  due  to  Kuo  [73. 
Let  B  denote  a  real  separable  Banach  space  with  norm  ||  *||  .  It  is 
known  [9]  that  each  Gaussian  measure  on  the  Borel  sets  of  B  can  be 
induced  from  the  canonical  Gaussian  cylinder  set  measure  on 


a  separable  Hilbert  space  H  contained  in  B,  through  the  injection 
i  of  H  into  B.  The  triple  (i,  H,  B)  is  known  as  an  abstract 
Wiener  space.  Denote  the  inner  product  on  H  by  <•,  •>  and  the  norm 
by  | • | .  The  pairing  between  B  and  B*  is  denoted  (•,  •).  As  in  [7] 
assume  the  following  condition  on  (i,  H,  B) :  There  exists  a  sequence 
of  finite  dimensional  projections  on  B  such  that  (1)  (B)  c 

rang*  (i#) *  (2)  converges  strongly  to  the  identity  in  both  B  and  H 
Let  W^,  taO  denote  the  B- valued  Wiener  process  derived  from 
(i,  H,  B) ,  see  [9].  Suppose  that  X^,  taO  is  a  B-valued  Ornstein- 
Uhlenbeck  process  satisfying  the  following  stochastic  integral  equa- 


(2.1) 


Xt  *  x0  *  /oA(Vds  ♦  wt»  1  *  °» 


where  xQ  e  B  and  A:B  -*•  H  is  a  bounded  linear  operator.  By  [7, 

Theorem  5.1)  (2.1)  has  a  unique,  non-anticipating,  continuous  so- 
T  T 

lution.  Let  and  ux  denote  the  measures  induced  on  C((0,  T),  B)  by 

(x0*Wt ,  tcCO,  T))  and  (Xt,  t<[0,  T))  respectively.  From  (8),  y* 

T 

and  uw  are  equivalent  and 

d  J 

(2.2)  -~<X)  -  expC  /J(A(Xt),  dXt)  -  ^ /J|A(Xt)  |2dt), 

dwW 

where  the  stochastic  integral  in  this  expression  is  defined  in  [7). 
The  true  generating  operator  A  of  the  observed  process  will  be  de¬ 
noted  Aq.  Since  the  maximum  likelihood  estimator  of  Aq  is  not  de¬ 
fined  in  general  it  is  necessary  to  restrict  the  family  of  possible 
generators.  Assume  that  A.  can  be  expressed  uniquely  in  the  form 


-  3  - 


k 

£  a ,A. ,  where  A.,  ,  A.  are  given  bounded  linear  operators 

j«l  3  3  1  K 

mapping  B  into  H  and  aj,  are  real  constants.  Let  a®,  . ... 

denote  the  true  values  of  the  coefficients  a^,  . ..,  and  write 
them  in  a  column  vector  as  a0.  The  maximum  likelihood  estimator 


4j.  of  a°  can  be  derived  from  (2.2)  Ccf.  43  and  is  given  by 

aT  *  c_1p, 

where  Pj  ■  /q(aj (xt)  *  dxt) * 


cij  *  ftw*  W>dt- 


3.  Results. 

An  operator  A:B  -►  H  is  said  to  be  dissipating  if  <Ax,  x>  £  0, 
for  all  x«H, and  symmetric  if  <Ax,  y>  *  <x,  Ay>,  for  all  x,  yeH. 

Assume  that  A^  is  dissipating  and  symmetric.  Since  i  is  a  compact 
operator,  see  C153,  i*A*  :H  H  is  compact.  Thus  i*A*  has  a  spectrum 
consisting  of  countably  many  eigenvalues  and  since  i*A*  is  symmetric, 
the  eigenvectors  belonging  to  district  eigenvalues  are  orthogonal, 
let  the  (strictly  negative)  eigenvalues  of  i*A*  be  denoted  {-Xn,  nstl), 
where  Xn  >  0  and  each  eigenvalue  is  counted  according  to  its  multiplicity. 
Let  corresponding  orthonormal  eigenvectors  be  denoted  (en,  nil). 

Assume  that  (en,  nil)  is  a  CONS  for  H,  The  following  condition  is  to 
be  imposed  on  operators  A:B  -*>  H. 

(Cl)  l  |i*A«(en)|2  <  -  . 
n«l  . 

n 

Theorem  3.1.  Suppose  that  the  operators  Aj,  ...,  commute  and 
satisfy  condition  (Cl) .  Then 

(a)  Aj.  — £-♦>  a0  as  T  «>  • 


-  4  - 


(b)  T^C^-a0)  —2—*-  N(0,  V'1)  as  T  +  -,  where  V  is  the  kxk 


■etTix  (Vjt)  given  by 


n*l 

This  result  will  be  proved  through  a  series  of  Lesaaata  for 
which  the  conditions  of  the  Theorem  are  assumed  to  hold. 

1 


3.1. 


T  cjt 


Vjt  **  T  +  *. 


&22L  Fi*  n*l.  D»«ne  processes  Y*  .  «e  ,  A, (X  )>,  J  .  <«  .  A.(WJ> 

f„M  1  1  1 

for  j  -  1,  2.  Then  Wt  « 


t 

W? 


is  a  two-dimensional  Wiener  process 


with  covsrtsace  (set)  £,  where  £  •  (oJt)  is  e  2»2  matrix  with 

“jl  ■  <l*AJV  ***tV-  *1  satisfies  the 

stochastic  differential  equation 

**{  *  ♦jCW^*  4  *{’  t  St  0 

Yo  ■  vv- 

**  VW*  m  *  (A5i-AJon,  Xt) 

•  V  since  Aq  and  A.  cooaute 

*  -VAJ'n*  *.5 

“  *  r.n 


Thus  Yt  ■ 


Let 


Y2 
*t  J 


satisfies  dYt  -  -jg^dt  ♦  d*t< 


P  - 


1  'fl2 

*22 
0  1 


*  Zt  -  PWt,  Ut  ■  PY 


t* 


-  5  - 


Then  (Z()  has  diagonal  covariance  (sAt)PSP"  Where 


"12 

n  -  0 

PEP '  -  °11  o22 

0  o- 


(Ut)  setifies  dUt  «•  -XnUtdt  ♦  dZt. 

►  • 

Now  Yt  «  -  uj  ♦  ^2.  uj  ,  so  that 


Y J  Y?  ■  111  U?  ♦  Cll?32 
t  t  t  t  o22  t 

and  it  follows  fran  the  independence  of  U1  and  U2  and  the  ergodic 


theorea  that 


T  /?  Yt  Ytdt  *  1XT*  *•**  M  T  ^ 


1  /T  <i*AJe  ,  i*Aie  > 

T  A)<en’  Al(Xt5>  <6n'A2(Xt)>dt  *  - n - * 


a. s.  as  T  4  •.  Since 


c12  *  V  ^  <en*  <cn*  ^^V*^**  *•*•» 

n«l 


the  proof  of  the 


will  be  complete  if  we  show  that 


T  l  /J«V  AiW,)*1* 

11*41 


2^ 


0,  as  b  4  «, 


uniformly  in  T.  Now,  since  <«n>  Aj(Xt)>  is  a  one  dimensional 
Omstein-Uhlenbeck  process  it  is  easily  checked  that 

B<V  W”  ■  e‘Xnt<en'  W”’ 

|i*AJ(e  ) | 2  . 

Var«°n,  A1(Xt)>  -  — -  -  (l-e’2Xnt) 


f  /JE<V  V*t>>2<lt  *  <en»  AlC*0>>2  + 


* 

for  all  T  >  0.  The  proof  is  completed  using  the  fact  that  A^(x0)«H 
and  condition  (Cl) .  Q 

la— i  3.3.  Let  A:B  -*•  H  be  a  bounded  linear  operator  which  commutes 
with  Aq  and  satifies  condition  (Cl) .  Then 


Rr  £  ^=./J(A(Xt) .  «Wt)  - SU  N(0,  D)  as  T  + 


i :  U*A#M2 

Where  D  -  i  J - r — —  . 

n-1  n 


Corollary  3.4.  ^  /J(A..  (Xt),  d*t)  — 2-*.  o  as  T  + 


Proof  of  hi  3,3.  Let  *h:H  ♦  H  denote  the  projection  onto  sp(e^,  . 
Denote 

*f  -  ^  iJcv°V  *  **> 

and  let  fn  «  X~1Ag(en) .  Note  that  i*(fn)  ■  en.  Thus 

«?  ■  ^  Jj  V*"?- 

Where  «  <fn,  Wt>.  The  (W^,  t  z  0),  n»l,  a  are  independent 
standard  Wiener  processes.  By  the  proof  of  Leema  3.2 


1  tT  2  !!***(•„)  I2 

T  •  V  dt  - 


TTT 


a.s. 


n 


as  T  ♦  •,  for  n  ■  1,  ....  a.  Thus,  by  Kutoyant's  Central  Limit  Theorem 
for  stochastic  integrals  [2,  p.  405]  it  follows  that 


«? 


N(0,  D*)  as  T  ♦  •,  where 


XtfM.’V.' 


+ .  i  f  vl 

n-1  \ 


-  7  - 


.  By  [7,  Theorem  3.2], 


BlRj  -  I^l2  -  /JlAC*t)  -  V(Xt,|2'lt 

■  ACX*,>2dt 


by  the  proof  of 


+  0  as  n  +  •,  uniformly  in  T  >  0, 
3.2.  In  particular  1®  ■■■  —  — »  Rj.  as  m  ®, 


uniformly  in  T  >  0.  By  the  usual  method  of  interchange  of  limits 
[13,  p.  28]  with  respect  to  weak  convergence,  we  conclude  that 
Rj  —  ■»  NCO,  D)  as  T  -*•  -.  Q 

Given  Lemmas  3.2  and  3.3,  the  proof  of  Theorem  3.1  now  follows 
along  the  lines  of  the  proof  given  by  Brown  and  Hewitt  [4,  p.  236] 
for  the  one  dimensional  case. 


a)  Analogous  versibns^offjheopeo  3;fc  could,  be.  obtained  for 
other  generalized  Omstein-Uhlenbeck  processes  considered  in  the 
literature  [6,  11,  12],  provided  the  appropriate  absolute  continuity 
results  are  available.  However,  one  would  need  to  be  ver^  careful}  in 
Bttch  cases,  to  avoid  the  problem  of  singularity.  Two  generalized  Omstein- 
Uhlenbeck  processes  (driven  by  the  same  Wiener  process)  on  a  spaceof 
distributions  can  have  singular  stationary  measures,  see  [16,  17]. 

b)  It  is  clear  from  our  method  of  proof  that  the  assumption, 

(en,  n  ^  1)  is  complete  in  H,  can  be  weakened*  to 

range  (Aj)  e  span  {en,  n  i  1),  for  j  ■  1,  ...,  k. 

c)  The  commutativity  assumption  in  Theorem  3.1  may  appear  restrictive, 
but  it  is  often  satisfied  in  applications.  For  example,  in  the  neural 


•  8  • 

mpooM  model  of  Walsh  [11]  it  is  of  interest  to  estimate  para¬ 
meters  e2  which  represent  characteristics  of  the  neuron  arising 
in  the  following  equation  for  the  neuron  potential  V(x,  t): 

dV  .  (6 -  0,V)dt  ♦  dW, 

where  W  is  white  noise  in  space- tine.  V  is  a  CCO,  L]  valued 

diffusion  process  observed  over  tine  [0,  T3.  Theorem  3.1  is  not 

a2 

applicable,  but  since  the  differential  operator  — *-  and  the  identity 
operator  commute  we  expect  that  estimation  of  0j,  b7  is  still 
possible.  Indeed,  one  way  of  doing  this  is  to  restrict  analysis  to 
the  finite  dimensional  Ornstein-Uhlenbeck  process  An(t)  ■  (Aq (t) ,  ..., 
where  ^(t)  can  be  expressed  [11.  p.  247]  in  terms  of  the  observed 
process  V.  The  unknown  parameters  02  appear  through  the  eigenvalues 
X^  of  the  separated  problem,  which  in  this  case  are  given  by 

tAV.  k  a  0.  The  process  An(t)  satisfies  the  stochastic 
differential  equation 

dAB(t)  •  -FAn(t)dt  ♦  dBn(t) , 

where  Bn(t)  is  an  (n+1)  -dimensional  Wiener  process  with  covariance 
(sAt)R,  R  »  (Pj^)  with  defined  in  [11,  p.  246],  F  is  the  diagonal 
matrix  with  diagonal  elements  x^,  k  ■  0,  . ..,  n.  The  usual  methods 
[2,  Ch.  9]  of  estimation  for  finite  dimensional  diffusion  processes 
can  be  applied  to  A®(t).  Provided  n  2  1,  so  that  0j,  $2  are 
identifiable,  the  maximum  likelihood  estimator  of  (0J#  02)  based  on 
dbeervstien  of  Arft)  is  consistent  and  asymptotically  normal. 
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